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Abstract 

This study investigates a powerful model, targeted to subjective 
assessments, based on pairwise comparisons. It provides a proof that 
a distance-based inconsistency reduction transforms an inconsistent 
pairwise comparisons (PC) matrix into a consistent PC matrix which 
is generated by the geometric means of rows of a given inconsistent 
PC matrix. The distance-based inconsistency indicator was defined 
in 1993 for pairwise comparisons. Its convergence was analyzed in 
1996 (regretfully, with an incomplete proof; finally completed in 2010). 
However, there was no clear interpretation of the convergence limit 
which is of considerable importance for applications and this study 
does so. This study finally ends the ongoing (since 1984) dispute on 
the approximation method for the inconsistent pairwise comparisons. 

The convergence limit is the vector of geometric means. It is not the 
principal right eigenvector of a given PC matrix. 
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1 Basic concepts of pairwise comparisons 

In modern science, we compare entities in pairs even without realizing it. For 
example, when someone asserts: “I am 18 years old,” one year is compared 
to the length of his/her life. It is a pair: one entity (year) is a unit and 
another entity is magnitude the life duration. When we have no unit (e.g., 
for software reliability), we may consider construction of a pairwise matrix to 
express our assessments based on relative comparisons of its attributes (such 
as safety or reliability). 

Pairwise comparisons is primarily about the information fusion from the 
most primitive pairwise (hence binary) to a single measure of the goal (such 
as importance or public safety). 

In this study, we assume that pairwise comparisons matrix (PC matrix 
here) is a square matrix M = [rriij], n x n, such that mij > 0 for every 
i,j = l,...,n. PC matrix M is called reciprocal if mij = ^ for every 
i,j = 1,.. ., n (in such case, mu = 1 for every i = 1,.. ., n). However, the 
blind wine testing may result not only in the lack of reciprocity but even 
in the lack of I’s on the main diagonal since, comparing the same wine to 
itself (especially at the end of the tasting day), may not necessary be cor¬ 
rect. Projects may be compared in different locations by different assessors 
due to the Internet. In such situation, it is even anticipated that some (if 
not most) assessments may not be reciprocal since one team of experts may 
assess project A to be more important for development than B and another 
team may assign the higher priority to B without even realizing that A/B 
was done so they could simply use the value 1/{A/B). 

Let us assume that: 


1 mi2 

A- 1 


min 

m2n 


A— — 

Lmin m2n 
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where mij expresses a relative preference of an entity Ei over Ej. An entity 
could be any object, attribute of it or a stimulus. 

A pairwise comparisons matrix M is called consistent (or transitive) if 


TTlij ' Tflj]^ 
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for every i,j,k = 1 , 2 ,..., n. 

We will refer to it as a “consistency condition.” In layman’s terms, when 
we have three entities: A, B, C, then A/B-B/C must yield the same result as 
the comparison A/C but often, it does not when these three comparisons are 
carried independently. When the comparisons or entities (safety, reliability, 
etc.) are subjective, the inconsistency is unavoidable in practice. In fact, the 
lack of inconsistency in such case may be suspicious but it does not mean 
that the inconsistency is desirable or that it should be tolerated. The “GIGO 
rule” (GIGO stands for “garbage-in, garbage-out”) in the held of computer 
science and information technology refers to the fact that the output quality 
depends on the quality of input data. It is not only common sense but the 
famous “modus ponens” (Latin for “the way that affirms by affirming”) in 
propositional logic which indicates the seriousness of the problem. It can be 
viewed as “P implies Q; P is asserted to be true, so therefore Q must be 
true” but it is the “Generalized Modus Ponens” in fuzzy logic which has a 
great application here. It generalizes the classical inferential rule of modus 
ponens and can be summarized (in layman’s terms) as: 

If the premise A' is slightly different from A, 
then the conclusion B' is slightly different from B. 

While every consistent matrix is reciprocal, the converse is false in gen¬ 
eral. If the consistency condition does not hold, the matrix is inconsistent 
(or intransitive). In at least four studies [TUI B El conducted between 
1939 and 1961, the inconsistency in pairwise comparisons was dehned and 
examined. 

Gonsistent matrices correspond to the ideal situation in which there are 
the exact values Ei,..., En for the stimuli. Then the quotients rriij = Ei/Ej 
form a consistent matrix. The vector s = [Ei,... Er/\ is unique up to a multi¬ 
plicative constant. The challenge of the pairwise comparisons method comes 
from the lack of consistency of the pairwise comparisons matrices which arises 
in practice (while, as a rule, all the pairwise comparisons matrices are recip¬ 
rocal). Given a n x n matrix M, which is not consistent, the theory attempts 
to provide a consistent n x n matrix M' which differs from matrix M “as 
little as possible”. 

The matrix: M = Ei/Ej is consistent for all (even random) values n*. It 
is an important observation since the consequence of it is that the approxi¬ 
mation is really a problem of the distance minimization. For the Euclidean 
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norm, the vector of geometric means (which is equal to the principal eigenvec¬ 
tor for a consistent PC matrix) is the one which generates it. Saaty’s seminal 
study [in] had a considerable impact on the pairwise comparisons research. 
It has strongly endorsed the use of eigenvector, corresponding to the princi¬ 
pal eigenvalue, for approximation of a given inconsistent but reciprocal PC 
matrix. 

In [T6|, a consistency index was proposed as a scaled deviation of the 
difference between matrix size and the principal eigenvalue: 

^j ^max ^ 

n — 1 


Conclusions of [H] include: 

“in this paper, by simulation analysis, we obtain the following 
result: as the matrix size increases, the percent of the matrices 
with acceptable consistency {CR < 0.1), decrease dramatically, 
but, on the other hand, there will be more and more contradictory 
judgments in these sufficiently consistent matrices. This paradox 
shows that it is impossible to hnd some proper critical values 
of CR for different matrix sizes. Thus we argue that Saaty’s 
consistency test could be unreasonable.” 

Authors of the above text use CR (for “Consistency Ratio”) while Cl (for 
“Consistency Index”) is more commonly used. 

In [H] , two counter-examples, with the mathematical reasoning and proofs, 
demonstrated that the eigenvalue-based inconsistency tolerates an error of 
any arbitrarily large value (e.g., 1,000,000% or whatever our imagination calls 
for). The eigenvalue-based inconsistency fails rather simple axioms proposed 
in [Tl|. The same reasoning is also applicable to any other panoptic incon¬ 
sistency indicator. By panoptic, we understand any type of a global char¬ 
acteristic including “averaging” statistics, outcomes from regression-based 
models or expressions using eigenvalues. The distance-based inconsistency 
(introduced in [TT]) is consistent with the simple axiomatization proposed in 

m 
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2 Inconsistency in pairwise comparisons 

As pointed out earlier, given an inconsistent PC matrix, a number of theories 
have attempted to approximate it with a consistent matrix that differs from 
matrix M “as little as possible.” Needless to say, that inconsistent assess¬ 
ments are inaccurate but after the approximation, they may reflect values 
that are useful for us. It must be stressed that there is no way to hnd the 
accurate values for the inconsistent input. By the dehnition, every approxi¬ 
mation has an approximation error. The approximation error, in inaccurate 
data, is the discrepancy between an exact value and some approximation of 
it. The approximation error is commonly used in science and engineering as 
a percentage of what we approximate. By reducing inconsistencies, a clearly 
undesirable property in every system, the estimation error disappears since 
there is no approximation error for fully consistent PC matrices. The exact 
solution for the consistent PC matrix is the geometric mean which also hap¬ 
pens to be the principal eigenvector. When normalized, they are identical. 
The distance-based inconsistency index was proposed in m as: 


a = max(min(|l — y/x/z\, |1 — x • z/y\)) 

for all triads (x, y, z) specihed by the consistency condition. 
It has been simplihed in na to: 


a 


which is equivalent to: 


max(l — mm( —, —)), 
xz y 


ii = max{l — e l^°(^^ 2 )l). 

The expression /(x, y,z) = | ln( —) | is the distance of a triad T from 0. When 
this distance increases, the f{x,y,z) also increases. It is important to notice 
here that this dehnition allows us to localize the inconsistency in a PC matrix 
and it is of a considerable importance for most applications. 

For a given PC matrix A, let us denote the vector of arithmetic means of 
rows by AM [A) and the vector of geometric means by GM{A). A vector of 
geometric means of rows of a given matrix A has a very natural interpretation. 
It is transformed into a vector of arithmetic means by a logarithmic mapping. 
The arithmetic mean has several properties that make it useful for a measure 
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of central tendency. Colloquially, measures of central tendency are often 
called averages. For values tCi,..., Wn, we have a mean w, for which: 

(wi - tc) + . . . + {Wn - w) = 0. 

We may consider that the values to the left of the mean are balanced by the 
values to the right of the mean since Wi — w is the distance from a given 
number to the mean. The mean is the only value for which the residuals 
(deviations from the estimate) sum to zero. When we are restricted to a 
single value for representing a set of known values wi,... ,Wn, the arithmetic 
mean may be used since it minimizes the sum of squared deviations from the 
typical value: the sum of {wi — u))^. In other words, the sample mean is also 
the best predictor in the sense of having the lowest root mean squared error. 
Means were analyzed in [1] and in [2] . It is difficult to state when exactly the 
logarithmic mapping was used for PC matrices as an alternative method for 
scaling priorities in hierarchical structures. However, it is usually attributed 
to Jensen. His results in [H] occur in the same journal in which |Tn] was 
published. Numerous subsequent Monte Carlo experiments have validated 
Jensen’s findings (e.g., [8] used 1,000,000 matrices). 

For a matrix A with positive coordinates, we define the matrix B = A(H) 
such that bij = In(aij). Reversely, for a matrix R, we define the matrix 
A = /i(iJ) such that = exp(6jj). By ln(a;i,... ,Xn) and exp(a:i,... ,x„) 
denote vectors (In(xi),..., ln(x„)) and (exp(xi),... ,exp(x„)), respectively. 
It implies that: 

\n{GM{A)) = AM{X{A)) (1) 

and 

exp{AM{B)) = GM{p{B)). (2) 

If A is consistent, then elements of i? = A(H) satisfy 

bij A bji^ bijf 

for every i,j,k = 1, 2,..., n. We call such a matrix additively consistent. 

Let us consider an additive triad (x, y, z) (given or after the logarithmic 
transform). It is consistent if y = x A z which is equivalent to the inner 
product of n = (x, y, z) by the vector e = (1, —1,1), giving 0. This indicates 
that V and e are perpendicular vectors. In other words, if a triad is incon¬ 
sistent, an orthogonal projection onto subspace perpendicular to the vector 
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e = (1, —1,1) in the space makes it consistent, 
expressed by: 


V o e 

V = V -e, 

e o e 


Such projections can be 


where Ui o U 2 is the inner product of vectors Ui and U 2 in 


It holds: 


hence v = Av, 
where: 


eoe = 3, voe = x — y + z, 


A 


3 3 
1 2 

! ! 


3 J 


Remark. A given inconsistent triad (x, ?/, z) can be transformed into a 
consistent triad in the following three ways: 


(x,x + z,z), (y-z,y,z), (x,y,y-x). 

For a multiplicatively inconsistent triad ( 0 *^, ajj, its transformation 
to the consistent triad {dik,aij,akj) is given by: 

2/3 1/3 -1/3 ~ 1/3 2/3 1/3 ~ -1/3 1/3 2/3 

o-ik — 0>ik ^kj 1 ~ ^ik ^ij '^kj ’ — 0>ik ^^kj ' 


The above formulas were used in [T2] for a Monte Carlo experimenta¬ 
tion with the convergence of inconsistency by the sequence of inconsistency 
reductions of the most inconsistent triad. 


3 The geometric means and eigenvector 

The n-th step of the algorithm used in [S] transforms the most inconsistent 
triad {aij,aik,ajk) = {x,y,z) of a given matrix An into v according to the 
formulas (??),(??),(??). Obviously, we also replace {aji,aki,akj) with —v, 
leaving the rest of the entries unchanged. Let An+i denote the matrix after 
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the transformation. The coordinates of AM [An) may change only for the 
Tth, j-th and the fc-th position. However, an elementary calculation shows 
that 


This proves that 


X + y 

= X + y 

( 3 ) 

—X + 5 

= —X + 2 ; 

( 4 ) 

-y-z 

= -y-z 

( 5 ) 

AM{An) 

= AM{An+l). 

( 6 ) 


Theorem 4. Let A € and B = = A(A). 

Let w : {1,2,...} —+ (1. be a se- 

quence of “greedy choices”, meaning that w and 
the sequence of matrices Bn such that Bn = 
for every n = 1,2,... satisfy the con¬ 
dition d{Bn-\,L^,(^n)) = maxveL^(^n-i,V) for 
every n = 1,2,.... Furthermore, let Y = 

X = fJi{Y) and An = for n = 0,1,_ Then 

X = lim„_,oo Is a consistent matrix. 


Figure 1: Theorem 4 from |H] 


Theorem 4 in [8] (copied as it is for the traditional reasons and presented 
by Fig. 0 states that: An is convergent to the orthogonal projection of 
Ai onto the linear space of additively consistent matrices. From the above 
theorem and ([^, we get: 

Theorem 1. For a given matrix 


A 


0 ai2 

—ai2 0 


®ln 

a2n 




0 
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and its orthogonal projection A' onto the space of additively consistent ma¬ 
trices we have: 

AM{A) = AM{A'). 

The following two examples illustrate how the above works in practice. 
Example 1. Consider a classic PC matrix, introduced in m- 


5.313293 
2.823108 
1 

The first PC matrix is inconsistent since 2-3 ^ 5. The vector of geometric 
means in both cases is the same and equal to 

■2.15443469' 

1.14471424 

0.40548013 

Example 2. Consider a matrix: 

0 a 6 c 
—a Ode 
—b —d 0 / 

_-c -e -/ 0_ 

The linear space of all such matrices is isomorphic with M®. 

For such matrix to be additively consistent, the following system of equa¬ 
tion must hold: 


I 1 3 
lI I 1 

After the orthogonal transform we get: 


1 2 


1 1.882072 

0.531329 1 

0.188207 0.35422 


Ui a d = b 
U 2 -.d + f = e 
U 3 : a e = c 
U^:b + f = c 
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Each equation describes a subspace Ui of the dimension 5. Subspace W 
of the consistent matrices is the intersection having dimension 3. 

A matrix can be made consistent with the algorithm used in |S]. It 
corrects the most inconsistent triad, which corresponds to the orthogonal 
projection on Ui. Another possible solution is the orthogonal projection on 
W. As a result, we obtain the matrix 


0 

A 

B 

C 

-A 

0 

D 

E 

-B 

-D 

0 

E 

-G 

-E 

-E 

0 


where: 


'A' 


2a + h + c — d — e 

B 


Qj “h 26 -\- c d — f 

G 

1 

Qj -\- h -\- 2c G f 

D 

4 

— Qj -|- 6 “h 2d G — f 

E 


— Q G d 2 g "f“ f 

E 


—6 “he — d G 2f 


Equations (§.(§ and Theorem imply that for any reciprocal matrix M 
to obtain the vector of weights of the closest consistent matrix, it is enough 
to calculate GM{M). In general, it is not so with the EV{M), i.e. an 
eigenvector corresponding to the principal eigenvalue of M. 

Remark 1. Assume 

M 

is a reciprocal matrix. 

Then 


a 


^ 1 c 

a 

I - 1 

0 c 


GM{M) = EV{M) 


Proof. Put 


V := GM{M) 




L 
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Then for A 
proof. 


1 + 


3/M _L 
V b ^ 



we have Mv 


Xv and it completes the 


□ 


The above remark cannot be generalized to matrices of higher degrees. 


Example 3. Consider the matrix: 


Then 


M 


1 

1 

2 

1 

1 

.3 


2 

1 

1 

1 


3 

1 

2 

1 


V := GM{M) 



and there is no A such that Mv = Xv, and it follows that GM{M) ^ EV (M). 
Vector GM{M) generates the consistent matrix which is the closest to M. 
Consequently, EV{M) does not. 


For a given inconsistent PC matrix A, we can hnd a consistent PC matrix 
by one transformation which is evidently [vi/vj\ and Vi = GMi{A) {GMi{A) 
= geometric mean of the i-th row of A). The triad-by-triad reduction for 
n = 3 is simple since there is only one triad hence only one transformation 
is needed. Orthogonal transformations may be indehnite for n > 3 but the 
convergence is very quick, as demonstrated by [12] and usually, fewer than 
10 steps are needed in most applications. 

For an inconsistent matrix, we hnd the most inconsistent triad (according 
to ii) and by using the three expressions for the orthogonal projection, we 
make it consistent. The idea of the algorithm is shown in Fig. We only 
need one step for a PC matrix 3x3 since there is only one triad and changing 
it does not inhuence “other triads”. When n > 3, changes to all three values 
in one triad propagate to other triads. It is not evident for n —)■ cxd how 
the propagation may go. However, the proof of convergence was provided 
independently in [Ij and in |T3| and resulted in Theorem 1 (Fig. |^. 
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Figure 2: Orthogonal projections 


Eventually, we get a consistent matrix which can be obtained from a 
vector of geometric means of rows of the original inconsistent matrix. The 
result is of considerable importance since the principal eigenvector of the 
input matrix is assumed to be the only solution according to [16] but it is in 
the direct contradiction with the mathematical proofs provided here. 

The presented results in this study are also consistent with Endings in 
[3], explicitly stating in its conclusions that: 

Our main conclusion is that, although the EM is very elegant 
from a mathematical viewpoint, the priority vector derived from 
it can violate a condition of order preservation that, in our opin¬ 
ion, is fundamental in decision aiding - an activity in which it is 
essential to respect values and judgments. In light of that, and 
independently of all other criticisms presented in the literature, 
we consider that the EM has a serious fundamental weakness that 
makes the use of AHP as a decision support tool very problem- 
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Theorem 1. Let C be a non-empty finite family of the linear subspaces ofM^. Let W = f^C 
be the intersection of members of C. Let w:N—>-C be a sequence sueh that for any V eC the 
equality w{n)= V holds for infinitely many neN. Fix and define xo = x and 

— Pw(n)(^ti—l) 


for 71 > 1. Then 


lim2:„=Pn/{a:). 


Figure 3: Theorem 1 from PI 


atic. 

EM in the quoted text stands for “eigenvector method”. 

4 Conclusions 

This study hnally closes the ongoing (since 1983 when [9] was published) 
dispute whether the principal eigenvector or a vector of geometric means is 
a better approximation for an inconsistent PC matrix. For fully consistent 
pairwise comparisons matrices, such dispute has no scientihc merits since the 
principal eigenvector EV is equal to the vector GM of geometric means of 
rows. For inconsistent pairwise comparisons, numerous Monte Carlo experi¬ 
ments (starting with the hrst study [U] and with 1,000,000 analyzed cases in 
m) demonstrated that, for the Euclidean distance, EE—generated approxi¬ 
mation of A is (on average) not as close as the one generated by GM. 

The difference between GM and EV approximations is not of noticeable 
signihcance from the application point of view for “not-so-inconsistent” (NSI) 
PC matrices (NSI concept was introduced in |H]). If the difference is small, 
why bother? The difference between Newton’s law of universal gravitation 
and the theory of relativity is small yet one can miss a planet. In fact, the 
accuracy of approximation is not really of great importance considering that 
the input (ofter highly subjective) may be inconsistent and plus/minus 10% 
accuracy would be more of a dream than reality. Often, EV and GM differ 
by the third or second decimal digit while the signihcance of even the hrst 
decimal digit of the input data may be questioned. It is the inconsistency im¬ 
provement which really contributes to the approximation accuracy improve¬ 
ment. For this reason, the convergence of the inconsistency improvement to 
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the vector of geometric means; not to the principal eigenvector, is of the fnn- 
damental importance, not only to hnally conclnde the ongoing (since 1984) 
dispute what is (or not) better but also for practical applications. Geometric 
means can be computer with a pocket calculator (Gnumerics and Excel are 
even easier to use) while computing the principal eigenvector is not as easy 
as computing geometric means. An eigenvalue perturbation problem exists 
and Ending the eigenvectors and eigenvalues of a system that is perturbed 
from known eigenvectors and eigenvalues is not a trivial problem to handle. 

It is worth noticing that the simplified version of pairwise comparisons, 
presented in na does not have inconsistencies. PG matrix elements are 
generated from a set of principal generators, preserving the consistency con¬ 
dition. 

The pairwise comparisons method has been implemented, as a part of 
the cloud computing support, for a group decision making process used by 
software development team at Health Sciences North (a regional hospital in 
Sudbury, Ontario). The software is available for downloading from Source- 
Forge.net). With more than 400K projects and over 3 million registered 
users, it is one of the biggest repositories in the world of open source soft¬ 
ware development projects. 
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